None
# Create a temporary directory to hold notebook output, and change the working directory to that directory.
from tempfile import TemporaryDirectory
import os
import shutil
data_dir = TemporaryDirectory()
os.chdir(data_dir.name)
import os
if 'CRDS_CACHE_TYPE' in os.environ:
if os.environ['CRDS_CACHE_TYPE'] == 'local':
os.environ['CRDS_PATH'] = os.path.join(os.environ['HOME'], 'crds', 'cache')
elif os.path.isdir(os.environ['CRDS_CACHE_TYPE']):
os.environ['CRDS_PATH'] = os.environ['CRDS_CACHE_TYPE']
print('CRDS cache location: {}'.format(os.environ['CRDS_PATH']))
CRDS cache location: /grp/crds/cache
The library imports relevant to this notebook are aready taken care of by importing the NIRSpec Pipeline Testing Tool.
NOTE: This notebook assumes that the pipeline version to be tested is already installed and its environment is activated.
To be able to run this notebook you need to install NPTT (https://github.com/spacetelescope/nirspec_pipe_testing_tool).
If the installation is successful, you will be able to import NPTT.
import warnings
import psutil
from astropy.io import fits
# Only print a DeprecationWarning the first time it shows up, not every time.
with warnings.catch_warnings():
warnings.simplefilter("once", category=DeprecationWarning)
import jwst
from jwst.pipeline.calwebb_detector1 import Detector1Pipeline
from jwst.assign_wcs.assign_wcs_step import AssignWcsStep
from jwst.msaflagopen.msaflagopen_step import MSAFlagOpenStep
from jwst import datamodels
# The latest version of NPTT is installed in the requirements text file at:
# /jwst_validation_notebooks/environment.yml
# import NPTT
import nirspec_pipe_testing_tool as nptt
# To get data from Artifactory
from ci_watson.artifactory_helpers import get_bigdata
# Make sure that the version used is the right one
pipeline_version = jwst.__version__
nptt_version = nptt.__version__
print("Using jwst pipeline version: ", pipeline_version)
print("Using NPTT version: ", nptt_version)
Using jwst pipeline version: 1.8.2 Using NPTT version: 2.0.1
The test is a comparison of the result of our implementation of the MSA Failed Open Flagging step algorithm versus the pipeline's implementation.
The overlap between the pixels flagged as being affected by failed open shutters are compared in regions large enough in the spectral direction to account for the non-repeatable motion of the grating wheel (a few pixels).
For the test to be considered PASSED, the overlap between the results of the two methods should be greater than or equal to msa_flagging_threshold percent for all failed open shutters affecting more than 100 pixels.
The code for these Multi Object Spectroscopy (MOS) and Integral Field Unit (IFU) tests can be obtained from: https://github.com/spacetelescope/nirspec_pipe_testing_tool/blob/master/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/msa_flagging_testing.py. This pipeline step and the associated pytests are skipped if data is Fixed Slits (FS) or Bright Object Time Series (BOTS).
The input file is defined in the variable input_file (see section Testing Data Set and Variable Setup).
Step description: https://jwst-pipeline.readthedocs.io/en/latest/jwst/msaflagopen/index.html
Pipeline code: https://github.com/spacetelescope/jwst/tree/master/jwst/msaflagopen
If the test PASSED this means that all slitlets or slices individually passed the test. However, if ony one individual slitlet (for MOS data) or slice (for IFU data) test failed, the whole test will be reported as FAILED.
A short description and link to the page: https://outerspace.stsci.edu/display/JWSTCC/Vanilla+MSA+Failed+Open+Flagging
Acronymns used in this notebook:
pipeline: calibration pipeline
cal_detector1: calibration pipeline Stage 1, detector processing
spec2: calibration pipeline spectroscopic Stage 2, spectroscopic processing
NPTT: NIRSpec Pipeline Testing Tool
The pipeline can be run from the command line in two variants: full or per step.
To run the spec2 pipeline in full use the command:
$ strun jwst.pipeline.Spec2Pipeline jwtest_rate.fits
where jwtest_rate.fits is the output of cal_detector1.
To only run the msa_flagging step, use the command:
$ strun jwst.msaflagopen.msaflagopen_step jwtest_assign_wcs.fits
where jwtest_assign_wcs.fits is the output of the previous step, assign_wcs.
NIRSpec TA data will be run through the calwebb_detector1 and the imaging2 pipelines. The imaging pipeline can be run with the following command:
$ strun jwst.pipeline.Image2Pipeline jwtest_rate.fits
These options are also callable from a script with the testing environment active. The Python call for running the pipeline in full or by step are:
$\gt$ from jwst.pipeline.calwebb_spec2 import Spec2Pipeline
$\gt$ Spec2Pipeline.call(jwtest_rate.fits)
or
$\gt$ from jwst.msaflagopen.msaflagopen_step import msaflagopen_step
$\gt$ msaflagopen_step.call(jwtest_rate.fits)
For the imaging pipeline the call would be as follows:
$\gt$ from jwst.pipeline.calwebb_image2 import Image2Pipeline
$\gt$ Image2Pipeline.call(jwtest_rate.fits)
NPTT can run the spec2 pipeline either in full or per step, as well as the imaging pipeline in full. In this notebook we will use NPTT to run the pipeline and the validation tests. To run NPTT, follow the directions in the corresponding repo page.
All testing data is from the CV3 campaign. We chose these files because this is our most complete data set, i.e. all modes and filter-grating combinations.
Data used for testing:
testing_data = {
'mos_prism_clear':{
'uncal_file_nrs1': 'mos_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'mos_prism_nrs2_uncal.fits',
'msa_shutter_config': 'V0030006000104_msa.fits' },
'mos_g140m_f100lp':{
'uncal_file_nrs1': 'mos_g140m_line1_NRS1_uncal.fits',
'uncal_file_nrs2': 'mos_g140m_line1_NRS2_uncal.fits',
'msa_shutter_config': 'V8460001000101_msa.fits' },
'ifu_prism_clear':{
'uncal_file_nrs1': 'ifu_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'ifu_prism_nrs2_uncal.fits',
'msa_shutter_config': None },
'ifu_g395h_f290lp':{
'uncal_file_nrs1': 'ifu_g395h_f290lp_nrs1_uncal.fits',
'uncal_file_nrs2': 'ifu_g395h_f290lp_nrs2_uncal.fits',
'msa_shutter_config': None }
}
# define function to pull data from Artifactory
def get_artifactory_file(data_set_dict, detector):
"""This function creates a list with all the files needed per detector to run the test.
Args:
data_set_dict: dictionary, contains inputs for a specific mode and configuration
detector: string, either nrs1 or nrs2
Returns:
data: list, contains all files needed to run test
"""
files2obtain = ['uncal_file_nrs1', 'msa_shutter_config']
data = []
for file in files2obtain:
data_file = None
try:
if '_nrs' in file and '2' in detector:
file = file.replace('_nrs1', '_nrs2')
data_file = get_bigdata('jwst_validation_notebooks',
'validation_data',
'nirspec_data',
data_set_dict[file])
except TypeError:
data.append(None)
continue
data.append(data_file)
return data
# Set common NPTT switches for this test
# accepted threshold difference with respect to benchmark files
msa_flagging_threshold = 99.5
# other NPTT variables
stellarity = None
operability_ref = None
source_type = None
save_figs = False
show_figs = True
debug = False
verbose = False
# Get the data
results_dict = {}
detectors = ['nrs1', 'nrs2']
for mode_config, data_set_dict in testing_data.items():
for det in detectors:
print('Testing files for detector: ', det)
data = get_artifactory_file(data_set_dict, det)
uncal_file, msa_shutter_config = data
print('Working with uncal_file: ', uncal_file)
uncal_basename = os.path.basename(uncal_file)
# Run the stage 1 pipeline
rate_object = Detector1Pipeline.call(uncal_file)
# Make sure the MSA shutter configuration file is set up correctly
if msa_shutter_config is not None:
msa_metadata = rate_object.meta.instrument.msa_metadata_file
print(msa_metadata)
if msa_metadata is None or msa_metadata == 'N/A':
rate_object.meta.instrument.msa_metadata_file = msa_shutter_config
# Run the stage 2 pipeline steps
try:
pipe_object = AssignWcsStep.call(rate_object)
skip_file = False
except:
print("An error occured with AssignWcs. Likely: No open slits fall on detector", det)
print("Skipping test for this file. \n")
skip_file = True
if not skip_file:
msa_flagging_object = MSAFlagOpenStep.call(pipe_object)
# Run the validation test
%matplotlib inline
result, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.msa_flagging_testing.run_msa_flagging_testing(
msa_flagging_object,
msa_flagging_threshold = msa_flagging_threshold,
rate_obj = rate_object,
stellarity = stellarity,
operability_ref = operability_ref,
save_figs = save_figs,
show_figs = show_figs,
source_type = source_type,
debug = debug)
else:
result = 'skipped'
# Did the test pass
print("Did msa_flagging validation test pass? ", result, "\n\n")
rd = {uncal_basename: result}
results_dict.update(rd)
# close all open files
psutil.Process().open_files()
closing_files = []
for fd in psutil.Process().open_files():
if data_dir.name in fd.path:
closing_files.append(fd)
for fd in closing_files:
try:
if verbose:
print('Closing file: ', fd)
open(fd.fd).close()
except:
if verbose:
print('File already closed: ', fd)
Testing files for detector: nrs1 Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_prism_nrs1_uncal.fits
2022-12-03 23:52:23,634 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2022-12-03 23:52:23,662 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-03 23:52:23,664 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-03 23:52:23,665 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-03 23:52:23,666 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-03 23:52:23,667 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-03 23:52:23,669 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-03 23:52:23,670 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-03 23:52:23,671 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-03 23:52:23,672 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-03 23:52:23,673 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-03 23:52:23,674 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-03 23:52:23,675 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-03 23:52:23,676 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-03 23:52:23,678 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-03 23:52:23,679 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-03 23:52:23,680 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-03 23:52:23,682 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-03 23:52:23,894 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_prism_nrs1_uncal.fits',).
2022-12-03 23:52:23,904 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-03 23:52:24,090 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-03 23:52:24,102 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits'.
2022-12-03 23:52:24,105 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-12-03 23:52:24,107 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2022-12-03 23:52:24,109 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2022-12-03 23:52:24,111 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-03 23:52:24,111 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2022-12-03 23:52:24,113 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits'.
2022-12-03 23:52:24,117 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-03 23:52:24,117 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-03 23:52:24,117 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2022-12-03 23:52:24,120 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits'.
2022-12-03 23:52:24,122 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-03 23:52:24,122 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-03 23:52:24,123 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-03 23:52:24,576 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:24,577 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:52:24,718 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-03 23:52:24,719 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-03 23:52:24,722 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-03 23:52:24,919 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:24,922 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:52:24,945 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2022-12-03 23:52:26,033 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-03 23:52:26,233 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:26,235 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-03 23:52:26,259 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2022-12-03 23:52:28,371 - stpipe.Detector1Pipeline.saturation - INFO - Detected 49730 saturated pixels
2022-12-03 23:52:28,405 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-03 23:52:28,432 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-03 23:52:28,608 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:28,610 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:52:28,611 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-03 23:52:28,614 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-03 23:52:28,764 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:28,766 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:52:28,797 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-12-03 23:52:34,630 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-03 23:52:34,873 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:34,876 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-03 23:52:34,909 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits
2022-12-03 23:52:38,832 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-12-03 23:52:53,395 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-03 23:52:53,717 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:53,720 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:52:53,748 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2022-12-03 23:52:58,545 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-03 23:52:58,681 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:52:58,683 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-03 23:52:58,768 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits
2022-12-03 23:53:41,597 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2022-12-03 23:53:41,599 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-12-03 23:53:42,189 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-03 23:53:42,365 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:53:42,367 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-03 23:53:42,406 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-03 23:53:42,451 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-12-03 23:53:42,555 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-12-03 23:53:44,180 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-03 23:53:44,224 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-03 23:53:45,682 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from five or more groups.
2022-12-03 23:53:46,312 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 2.13119 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-03 23:53:46,367 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 3.960269
2022-12-03 23:53:46,373 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-03 23:53:46,527 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:53:46,529 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-03 23:53:46,626 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-12-03 23:53:46,627 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-12-03 23:53:46,750 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-03 23:53:46,751 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-03 23:54:01,164 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2022-12-03 23:54:01,165 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-03 23:54:01,352 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-03 23:54:01,510 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:54:01,512 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:54:01,591 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:54:01,592 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:54:01,597 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:54:01,712 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:54:01,714 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:54:01,788 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:54:01,789 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:54:01,794 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:54:01,795 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-03 23:54:01,795 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:54:01,795 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-03 23:54:01,806 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:54:01,924 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:54:01,925 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
N/A
2022-12-03 23:54:02,083 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-03 23:54:02,129 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-12-03 23:54:02,130 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-12-03 23:54:02,131 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-12-03 23:54:02,133 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:54:02,413 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [3, 4]
2022-12-03 23:54:02,414 - stpipe.AssignWcsStep - INFO - Computing WCS for 2 open slitlets
2022-12-03 23:54:02,454 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-12-03 23:54:02,455 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-12-03 23:54:02,455 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-12-03 23:54:02,457 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:54:02,472 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-12-03 23:54:02,626 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2022-12-03 23:54:02,627 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-12-03 23:54:02,627 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 3
2022-12-03 23:54:02,636 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 4
2022-12-03 23:54:02,646 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-03 23:54:02,824 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/V0030006000104_msa.fits'}
2022-12-03 23:54:03,018 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-03 23:54:03,032 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:54:03,032 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-12-03 23:54:03,042 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-12-03 23:54:03,178 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:54:03,179 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-03 23:54:03,197 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-12-03 23:54:03,198 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-12-03 23:54:03,323 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-12-03 23:54:03,324 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-12-03 23:54:03,325 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-12-03 23:54:03,326 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:54:03,340 - stpipe.MSAFlagOpenStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-12-03 23:54:03,490 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-12-03 23:54:03,528 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-12-03 23:54:03,552 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-12-03 23:54:03,621 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-12-03 23:54:03,645 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2588.086193887466.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2332.7637849323596.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2734.225436305883.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2098.587600763162.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2088.836558573466.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-12-03 23:54:16,565 - stpipe.MSAFlagOpenStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:54:16,566 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-12-03 23:54:17,382 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:54:17,393 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:54:17,646 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-12-03 23:54:17,648 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.45, 'slit_y_high': 0.45}
2022-12-03 23:54:17,794 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-03 23:54:17,855 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-12-03 23:54:17,856 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-12-03 23:54:17,857 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-12-03 23:54:17,859 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:54:18,073 - stpipe.AssignWcsStep - INFO - Removing slit 1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:54:18,112 - stpipe.AssignWcsStep - INFO - Removing slit 2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:54:18,294 - stpipe.AssignWcsStep - INFO - Removing slit 6 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:54:18,339 - stpipe.AssignWcsStep - INFO - Removing slit 7 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:54:18,385 - stpipe.AssignWcsStep - INFO - Removing slit 8 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:54:18,928 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [3, 4, 5, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19]
2022-12-03 23:54:18,930 - stpipe.AssignWcsStep - INFO - Computing WCS for 14 open slitlets
2022-12-03 23:54:18,967 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-12-03 23:54:18,969 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-12-03 23:54:18,969 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-12-03 23:54:18,971 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:54:18,987 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-12-03 23:54:19,150 - stpipe.AssignWcsStep - INFO - There are 3 open slits in quadrant 1
2022-12-03 23:54:19,175 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-12-03 23:54:19,177 - stpipe.AssignWcsStep - INFO - There are 9 open slits in quadrant 3
2022-12-03 23:54:19,244 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2022-12-03 23:54:19,261 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-03 23:54:19,414 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'fopens_metafile_msa.fits'}
2022-12-03 23:54:20,057 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-03 23:54:20,073 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:54:20,073 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
Working with slit/slice: 3 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[2007 2048] [1630 1638]] Max value in slity array (ignoring NANs): 0.49934753059464704 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 4 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[2017 2048] [1320 1328]] Max value in slity array (ignoring NANs): 0.4992600265017523 percentage of F/O trace that was flagged: 96.6
Working with slit/slice: 5 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1873 2048] [1590 1600]] Max value in slity array (ignoring NANs): 0.49970473402574966 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 9 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1511 1939] [1262 1270]] Max value in slity array (ignoring NANs): 0.47541638939121267 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 10 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1515 1943] [1230 1240]] Max value in slity array (ignoring NANs): 0.4999677623917731 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 11 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1160 1594] [1828 1836]] Max value in slity array (ignoring NANs): 0.4975789418957247 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 12 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1213 1643] [1252 1260]] Max value in slity array (ignoring NANs): 0.4911821622434934 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 13 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 920 1356] [1692 1702]] Max value in slity array (ignoring NANs): 0.4997273932113973 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 14 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 819 1255] [1632 1642]] Max value in slity array (ignoring NANs): 0.4998008389664905 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 15 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 736 1172] [1376 1388]] Max value in slity array (ignoring NANs): 0.49973439389336194 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 16 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 656 1096] [1862 1874]] Max value in slity array (ignoring NANs): 0.49919217087642653 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 17 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 707 1144] [1518 1528]] Max value in slity array (ignoring NANs): 0.49950881420114257 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 18 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 859 1287] [ 206 214]] Max value in slity array (ignoring NANs): 0.4985413500738489 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 19 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 761 1193] [ 624 634]] Max value in slity array (ignoring NANs): 0.4996526774597415 percentage of F/O trace that was flagged: 99.8
* One or more traces show msa_flagging match < 99.5
See results above per trace.
*** Final result for msa_flagging test will be reported as FAILED ***
('* MSA flagging validation test took ', '14.498180150985718 seconds to finish.')
Did msa_flagging validation test pass? False
Testing files for detector: nrs2
2022-12-03 23:54:31,709 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_prism_nrs2_uncal.fits
2022-12-03 23:54:31,728 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-03 23:54:31,729 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-03 23:54:31,730 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-03 23:54:31,731 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-03 23:54:31,732 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-03 23:54:31,733 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-03 23:54:31,734 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-03 23:54:31,735 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-03 23:54:31,737 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-03 23:54:31,738 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-03 23:54:31,739 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-03 23:54:31,740 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-03 23:54:31,741 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-03 23:54:31,742 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-03 23:54:31,744 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-03 23:54:31,745 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-03 23:54:31,746 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-03 23:54:31,999 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_prism_nrs2_uncal.fits',).
2022-12-03 23:54:32,009 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-03 23:54:32,180 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-03 23:54:32,198 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits'.
2022-12-03 23:54:32,200 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-12-03 23:54:32,202 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2022-12-03 23:54:32,204 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2022-12-03 23:54:32,207 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-03 23:54:32,208 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2022-12-03 23:54:32,213 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits'.
2022-12-03 23:54:32,216 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-03 23:54:32,217 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-03 23:54:32,217 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2022-12-03 23:54:32,219 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits'.
2022-12-03 23:54:32,224 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-03 23:54:32,225 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-03 23:54:32,225 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-03 23:54:32,578 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:54:32,581 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:54:32,722 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-03 23:54:32,723 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-03 23:54:32,725 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-03 23:54:32,984 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:54:32,985 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:54:33,009 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2022-12-03 23:54:34,103 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-03 23:54:34,272 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:54:34,274 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-03 23:54:34,296 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2022-12-03 23:54:36,363 - stpipe.Detector1Pipeline.saturation - INFO - Detected 40672 saturated pixels
2022-12-03 23:54:36,387 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-03 23:54:36,411 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-03 23:54:36,543 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:54:36,544 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:54:36,545 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-03 23:54:36,548 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-03 23:54:36,675 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:54:36,676 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:54:36,700 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-12-03 23:54:40,985 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-03 23:54:41,129 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:54:41,130 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-03 23:54:41,155 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits
2022-12-03 23:54:44,981 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-12-03 23:54:58,857 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-03 23:54:59,127 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:54:59,128 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:54:59,155 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2022-12-03 23:55:04,776 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-03 23:55:04,922 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:55:04,923 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-03 23:55:04,998 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits
2022-12-03 23:55:45,219 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2022-12-03 23:55:45,220 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-12-03 23:55:45,778 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-03 23:55:45,944 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:55:45,946 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-03 23:55:45,978 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-03 23:55:46,017 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-12-03 23:55:46,110 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-12-03 23:55:47,518 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-03 23:55:47,559 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-03 23:55:49,000 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from five or more groups.
2022-12-03 23:55:49,369 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 1.85013 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-03 23:55:49,418 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 3.440148
2022-12-03 23:55:49,424 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-03 23:55:49,558 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:55:49,560 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-03 23:55:49,640 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-12-03 23:55:49,640 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-12-03 23:55:49,756 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-03 23:55:49,756 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-03 23:56:03,303 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2022-12-03 23:56:03,304 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-03 23:56:03,497 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-03 23:56:03,674 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:56:03,675 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:03,753 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:56:03,754 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:56:03,758 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:56:03,897 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:56:03,899 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:03,974 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:56:03,975 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:56:03,979 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:56:03,980 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-03 23:56:03,980 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:56:03,981 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-03 23:56:03,991 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:56:04,144 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-12-03 23:56:04,146 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
N/A
2022-12-03 23:56:04,372 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1 2022-12-03 23:56:04,417 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg 2022-12-03 23:56:04,418 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg 2022-12-03 23:56:04,418 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg 2022-12-03 23:56:04,420 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg 2022-12-03 23:56:04,659 - stpipe.AssignWcsStep - INFO - Removing slit 3 from the list of open slits because the WCS bounding_box is completely outside the detector. 2022-12-03 23:56:04,706 - stpipe.AssignWcsStep - INFO - Removing slit 4 from the list of open slits because the WCS bounding_box is completely outside the detector. 2022-12-03 23:56:04,707 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: [] 2022-12-03 23:56:04,708 - stpipe.AssignWcsStep - CRITICAL - No open slits fall on detector NRS2.
An error occured with AssignWcs. Likely: No open slits fall on detector nrs2 Skipping test for this file. Did msa_flagging validation test pass? skipped Testing files for detector: nrs1
2022-12-03 23:56:05,301 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_g140m_line1_NRS1_uncal.fits
2022-12-03 23:56:05,322 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-03 23:56:05,323 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-03 23:56:05,324 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-03 23:56:05,325 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-03 23:56:05,326 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-03 23:56:05,327 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-03 23:56:05,328 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-03 23:56:05,330 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-03 23:56:05,331 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-03 23:56:05,332 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-03 23:56:05,333 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-03 23:56:05,334 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-03 23:56:05,335 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-03 23:56:05,336 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-03 23:56:05,338 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-03 23:56:05,339 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-03 23:56:05,341 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-03 23:56:05,486 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_g140m_line1_NRS1_uncal.fits',).
2022-12-03 23:56:05,496 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-03 23:56:05,662 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_g140m_line1_NRS1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-03 23:56:05,673 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits'.
2022-12-03 23:56:05,675 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-12-03 23:56:05,677 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0019.fits'.
2022-12-03 23:56:05,678 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits'.
2022-12-03 23:56:05,680 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-03 23:56:05,680 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits'.
2022-12-03 23:56:05,682 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-12-03 23:56:05,682 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-03 23:56:05,683 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-03 23:56:05,683 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0023.fits'.
2022-12-03 23:56:05,686 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits'.
2022-12-03 23:56:05,688 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-03 23:56:05,689 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-03 23:56:05,689 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-03 23:56:06,024 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:06,026 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:06,128 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-03 23:56:06,129 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-03 23:56:06,131 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-03 23:56:06,271 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:06,273 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:06,295 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits
2022-12-03 23:56:06,538 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-03 23:56:06,674 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:06,675 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-03 23:56:06,698 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0023.fits
2022-12-03 23:56:07,930 - stpipe.Detector1Pipeline.saturation - INFO - Detected 108240 saturated pixels
2022-12-03 23:56:07,955 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-03 23:56:07,967 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-03 23:56:08,110 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:08,111 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:08,112 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-03 23:56:08,115 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-03 23:56:08,248 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:08,249 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:08,274 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits
2022-12-03 23:56:08,540 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-03 23:56:08,687 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:08,690 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-03 23:56:08,813 - stpipe.Detector1Pipeline.refpix - INFO - NIR full frame data
2022-12-03 23:56:08,814 - stpipe.Detector1Pipeline.refpix - INFO - The following parameters are valid for this mode:
2022-12-03 23:56:08,814 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-12-03 23:56:08,815 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-12-03 23:56:08,815 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-12-03 23:56:08,816 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-12-03 23:56:08,816 - stpipe.Detector1Pipeline.refpix - INFO - The following parameter is not applicable and is ignored:
2022-12-03 23:56:08,816 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = False
2022-12-03 23:56:11,262 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-03 23:56:11,402 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:11,404 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:11,428 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0019.fits
2022-12-03 23:56:12,170 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-03 23:56:12,309 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:12,311 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-03 23:56:12,334 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits
2022-12-03 23:56:12,600 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=6, nframes=1, groupgap=0
2022-12-03 23:56:12,601 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-12-03 23:56:12,875 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-03 23:56:13,014 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:13,016 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-03 23:56:13,027 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-03 23:56:13,041 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-12-03 23:56:13,124 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-12-03 23:56:13,377 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-03 23:56:13,417 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-03 23:56:15,662 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 41569 pixels with at least one CR from five or more groups.
2022-12-03 23:56:22,658 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.2794 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-03 23:56:22,734 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 9.707119
2022-12-03 23:56:22,740 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-03 23:56:22,897 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:22,899 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-03 23:56:22,937 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-12-03 23:56:22,937 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-12-03 23:56:23,065 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-03 23:56:23,066 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-03 23:56:48,885 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 6
2022-12-03 23:56:48,886 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-03 23:56:49,051 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-03 23:56:49,213 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:49,214 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:49,289 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:56:49,290 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:56:49,295 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:56:49,430 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:49,431 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:56:49,507 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:56:49,508 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:56:49,513 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:56:49,514 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-03 23:56:49,514 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:56:49,514 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-03 23:56:49,525 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:56:49,658 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:49,660 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
V8460001000101_msa.fits
2022-12-03 23:56:49,820 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-03 23:56:50,043 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:56:50,044 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:56:50,044 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:56:50,046 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:56:50,265 - stpipe.AssignWcsStep - INFO - Removing slit 6 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,278 - stpipe.AssignWcsStep - INFO - Removing slit 7 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,292 - stpipe.AssignWcsStep - INFO - Removing slit 8 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,305 - stpipe.AssignWcsStep - INFO - Removing slit 9 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,318 - stpipe.AssignWcsStep - INFO - Removing slit 10 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,331 - stpipe.AssignWcsStep - INFO - Removing slit 11 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,343 - stpipe.AssignWcsStep - INFO - Removing slit 14 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,356 - stpipe.AssignWcsStep - INFO - Removing slit 15 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,369 - stpipe.AssignWcsStep - INFO - Removing slit 16 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,382 - stpipe.AssignWcsStep - INFO - Removing slit 17 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,395 - stpipe.AssignWcsStep - INFO - Removing slit 18 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,408 - stpipe.AssignWcsStep - INFO - Removing slit 19 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,420 - stpipe.AssignWcsStep - INFO - Removing slit 21 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,433 - stpipe.AssignWcsStep - INFO - Removing slit 25 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,447 - stpipe.AssignWcsStep - INFO - Removing slit 26 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,460 - stpipe.AssignWcsStep - INFO - Removing slit 27 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,473 - stpipe.AssignWcsStep - INFO - Removing slit 29 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,486 - stpipe.AssignWcsStep - INFO - Removing slit 31 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,498 - stpipe.AssignWcsStep - INFO - Removing slit 32 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,511 - stpipe.AssignWcsStep - INFO - Removing slit 33 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,524 - stpipe.AssignWcsStep - INFO - Removing slit 35 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,537 - stpipe.AssignWcsStep - INFO - Removing slit 37 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,550 - stpipe.AssignWcsStep - INFO - Removing slit 38 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,563 - stpipe.AssignWcsStep - INFO - Removing slit 39 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,576 - stpipe.AssignWcsStep - INFO - Removing slit 41 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,616 - stpipe.AssignWcsStep - INFO - Removing slit 1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,629 - stpipe.AssignWcsStep - INFO - Removing slit 2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,642 - stpipe.AssignWcsStep - INFO - Removing slit 3 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,655 - stpipe.AssignWcsStep - INFO - Removing slit 4 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,668 - stpipe.AssignWcsStep - INFO - Removing slit 5 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,681 - stpipe.AssignWcsStep - INFO - Removing slit 12 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,693 - stpipe.AssignWcsStep - INFO - Removing slit 13 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,707 - stpipe.AssignWcsStep - INFO - Removing slit 20 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,719 - stpipe.AssignWcsStep - INFO - Removing slit 22 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,732 - stpipe.AssignWcsStep - INFO - Removing slit 23 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,745 - stpipe.AssignWcsStep - INFO - Removing slit 24 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,759 - stpipe.AssignWcsStep - INFO - Removing slit 28 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,772 - stpipe.AssignWcsStep - INFO - Removing slit 30 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,785 - stpipe.AssignWcsStep - INFO - Removing slit 34 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,799 - stpipe.AssignWcsStep - INFO - Removing slit 36 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:50,812 - stpipe.AssignWcsStep - INFO - Removing slit 40 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:56:51,115 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68]
2022-12-03 23:56:51,116 - stpipe.AssignWcsStep - INFO - Computing WCS for 27 open slitlets
2022-12-03 23:56:51,155 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:56:51,156 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:56:51,157 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:56:51,158 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:56:51,172 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-12-03 23:56:51,326 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 1
2022-12-03 23:56:51,343 - stpipe.AssignWcsStep - INFO - There are 11 open slits in quadrant 2
2022-12-03 23:56:51,427 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 3
2022-12-03 23:56:51,457 - stpipe.AssignWcsStep - INFO - There are 10 open slits in quadrant 4
2022-12-03 23:56:51,701 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-03 23:56:51,866 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'V8460001000101_msa.fits'}
2022-12-03 23:56:52,552 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-03 23:56:52,567 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:56:52,567 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-12-03 23:56:52,577 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-12-03 23:56:52,746 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:56:52,747 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-03 23:56:52,765 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-12-03 23:56:52,766 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-12-03 23:56:52,883 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:56:52,884 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:56:52,885 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:56:52,886 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:56:52,901 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-12-03 23:56:53,053 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-12-03 23:56:53,092 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-12-03 23:56:53,116 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-12-03 23:56:53,182 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-12-03 23:56:53,207 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2324.820049828629.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2244.599990785436.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-12-03 23:57:05,430 - stpipe.MSAFlagOpenStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:57:05,431 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-12-03 23:57:06,104 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:57:06,117 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:57:06,778 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-12-03 23:57:06,780 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.45, 'slit_y_high': 0.45}
2022-12-03 23:57:06,966 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-03 23:57:07,032 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:57:07,033 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:57:07,034 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:57:07,036 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:57:07,248 - stpipe.AssignWcsStep - INFO - Removing slit 1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:57:07,262 - stpipe.AssignWcsStep - INFO - Removing slit 2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:57:07,314 - stpipe.AssignWcsStep - INFO - Removing slit 6 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:57:07,483 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19]
2022-12-03 23:57:07,484 - stpipe.AssignWcsStep - INFO - Computing WCS for 16 open slitlets
2022-12-03 23:57:07,524 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:57:07,525 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:57:07,525 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:57:07,527 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:57:07,541 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-12-03 23:57:07,705 - stpipe.AssignWcsStep - INFO - There are 3 open slits in quadrant 1
2022-12-03 23:57:07,732 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 2
2022-12-03 23:57:07,750 - stpipe.AssignWcsStep - INFO - There are 9 open slits in quadrant 3
2022-12-03 23:57:07,825 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2022-12-03 23:57:07,844 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-03 23:57:08,018 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'fopens_metafile_msa.fits'}
2022-12-03 23:57:09,009 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-03 23:57:09,024 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:57:09,025 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
Working with slit/slice: 3 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1677 2048] [1630 1640]] Max value in slity array (ignoring NANs): 0.49983590702157094 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 4 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1628 2048] [1320 1330]] Max value in slity array (ignoring NANs): 0.4999416262418918 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 5 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1536 2048] [1592 1602]] Max value in slity array (ignoring NANs): 0.499395872247531 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 7 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1531 2048] [ 240 250]] Max value in slity array (ignoring NANs): 0.49982577845792203 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 8 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1510 2048] [ 164 174]] Max value in slity array (ignoring NANs): 0.4999363264129128 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 9 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1114 2048] [1260 1272]] Max value in slity array (ignoring NANs): 0.49973662248892214 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 10 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[1113 2048] [1230 1242]] Max value in slity array (ignoring NANs): 0.499843929708657 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 11 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 881 2048] [1826 1840]] Max value in slity array (ignoring NANs): 0.49948331088759856 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 12 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 822 2048] [1250 1264]] Max value in slity array (ignoring NANs): 0.4997723843713606 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 13 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 622 2048] [1688 1708]] Max value in slity array (ignoring NANs): 0.4999716020776064 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 14 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 514 1982] [1628 1648]] Max value in slity array (ignoring NANs): 0.4997611753551952 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 15 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 386 1852] [1372 1394]] Max value in slity array (ignoring NANs): 0.49974517536774626 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 16 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 404 1873] [1856 1880]] Max value in slity array (ignoring NANs): 0.4997112322262246 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 17 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 385 1852] [1512 1534]] Max value in slity array (ignoring NANs): 0.4998204880532977 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 18 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 312 1773] [ 202 220]] Max value in slity array (ignoring NANs): 0.4999855029608435 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 19 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 282 1744] [ 620 640]] Max value in slity array (ignoring NANs): 0.49987583080741427 percentage of F/O trace that was flagged: 100.0
*** Final result for msa_flagging test will be reported as PASSED ***
('* MSA flagging validation test took ', '20.799679040908813 seconds to finish.')
Did msa_flagging validation test pass? True
Testing files for detector: nrs2
2022-12-03 23:57:26,874 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_g140m_line1_NRS2_uncal.fits
2022-12-03 23:57:26,896 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-03 23:57:26,898 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-03 23:57:26,899 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-03 23:57:26,900 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-03 23:57:26,901 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-03 23:57:26,902 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-03 23:57:26,903 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-03 23:57:26,904 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-03 23:57:26,905 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-03 23:57:26,906 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-03 23:57:26,907 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-03 23:57:26,908 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-03 23:57:26,909 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-03 23:57:26,910 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-03 23:57:26,912 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-03 23:57:26,914 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-03 23:57:26,915 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-03 23:57:27,180 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/mos_g140m_line1_NRS2_uncal.fits',).
2022-12-03 23:57:27,190 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-03 23:57:27,363 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_g140m_line1_NRS2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-03 23:57:27,373 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits'.
2022-12-03 23:57:27,376 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-12-03 23:57:27,377 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0020.fits'.
2022-12-03 23:57:27,380 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits'.
2022-12-03 23:57:27,386 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-03 23:57:27,386 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits'.
2022-12-03 23:57:27,389 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-12-03 23:57:27,389 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-03 23:57:27,389 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-03 23:57:27,390 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0022.fits'.
2022-12-03 23:57:27,392 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits'.
2022-12-03 23:57:27,394 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-03 23:57:27,394 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-03 23:57:27,395 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-03 23:57:27,851 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:27,853 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:57:27,959 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-03 23:57:27,959 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-03 23:57:27,962 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-03 23:57:28,136 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:28,137 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:57:28,159 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits
2022-12-03 23:57:28,403 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-03 23:57:28,567 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:28,568 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-03 23:57:28,591 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0022.fits
2022-12-03 23:57:29,828 - stpipe.Detector1Pipeline.saturation - INFO - Detected 123449 saturated pixels
2022-12-03 23:57:29,857 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-03 23:57:29,872 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-03 23:57:30,074 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:30,076 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:57:30,076 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-03 23:57:30,079 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-03 23:57:30,244 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:30,245 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:57:30,269 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits
2022-12-03 23:57:30,542 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-03 23:57:30,712 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:30,713 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-03 23:57:30,816 - stpipe.Detector1Pipeline.refpix - INFO - NIR full frame data
2022-12-03 23:57:30,816 - stpipe.Detector1Pipeline.refpix - INFO - The following parameters are valid for this mode:
2022-12-03 23:57:30,817 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-12-03 23:57:30,817 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-12-03 23:57:30,817 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-12-03 23:57:30,818 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-12-03 23:57:30,818 - stpipe.Detector1Pipeline.refpix - INFO - The following parameter is not applicable and is ignored:
2022-12-03 23:57:30,819 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = False
2022-12-03 23:57:33,286 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-03 23:57:33,479 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:33,481 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:57:33,505 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0020.fits
2022-12-03 23:57:34,232 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-03 23:57:34,393 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:34,395 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-03 23:57:34,417 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits
2022-12-03 23:57:34,658 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=6, nframes=1, groupgap=0
2022-12-03 23:57:34,659 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-12-03 23:57:34,922 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-03 23:57:35,090 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:35,092 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-03 23:57:35,102 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-03 23:57:35,115 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-12-03 23:57:35,181 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-12-03 23:57:35,424 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-03 23:57:35,462 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-03 23:57:37,686 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 51081 pixels with at least one CR from five or more groups.
2022-12-03 23:57:47,401 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 11.9758 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-03 23:57:47,487 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 12.384300
2022-12-03 23:57:47,493 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-03 23:57:47,706 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:57:47,708 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-03 23:57:47,744 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-12-03 23:57:47,744 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-12-03 23:57:47,859 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-03 23:57:47,860 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-03 23:58:12,719 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 6
2022-12-03 23:58:12,721 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-03 23:58:12,879 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-03 23:58:13,084 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:58:13,085 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:58:13,166 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:58:13,167 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:58:13,172 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:58:13,331 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:58:13,333 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:58:13,424 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:58:13,425 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:58:13,430 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:58:13,430 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-03 23:58:13,431 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:58:13,431 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-03 23:58:13,441 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:58:13,602 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:58:13,604 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
V8460001000101_msa.fits
2022-12-03 23:58:13,768 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-03 23:58:13,990 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:58:13,991 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:58:13,992 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:58:13,993 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:58:14,897 - stpipe.AssignWcsStep - INFO - Removing slit 65 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:14,911 - stpipe.AssignWcsStep - INFO - Removing slit 66 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:14,924 - stpipe.AssignWcsStep - INFO - Removing slit 68 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:14,963 - stpipe.AssignWcsStep - INFO - Removing slit 58 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:14,978 - stpipe.AssignWcsStep - INFO - Removing slit 59 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:14,992 - stpipe.AssignWcsStep - INFO - Removing slit 60 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:15,006 - stpipe.AssignWcsStep - INFO - Removing slit 61 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:15,020 - stpipe.AssignWcsStep - INFO - Removing slit 62 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:15,035 - stpipe.AssignWcsStep - INFO - Removing slit 63 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:15,049 - stpipe.AssignWcsStep - INFO - Removing slit 64 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:15,063 - stpipe.AssignWcsStep - INFO - Removing slit 67 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:15,064 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57]
2022-12-03 23:58:15,064 - stpipe.AssignWcsStep - INFO - Computing WCS for 57 open slitlets
2022-12-03 23:58:15,102 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:58:15,103 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:58:15,103 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:58:15,105 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:58:15,120 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-12-03 23:58:15,274 - stpipe.AssignWcsStep - INFO - There are 27 open slits in quadrant 1
2022-12-03 23:58:15,476 - stpipe.AssignWcsStep - INFO - There are 27 open slits in quadrant 2
2022-12-03 23:58:15,919 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 3
2022-12-03 23:58:15,928 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2022-12-03 23:58:15,945 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-03 23:58:16,137 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'V8460001000101_msa.fits'}
2022-12-03 23:58:17,656 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-03 23:58:17,670 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:58:17,671 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-12-03 23:58:17,680 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-12-03 23:58:17,917 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:58:17,918 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-03 23:58:17,938 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-12-03 23:58:17,939 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-12-03 23:58:18,058 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:58:18,059 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:58:18,059 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:58:18,061 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:58:18,074 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-12-03 23:58:18,231 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-12-03 23:58:18,269 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-12-03 23:58:18,293 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-12-03 23:58:18,360 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-12-03 23:58:18,383 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -103.67242647612011 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -212.68515843943806 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -342.07188051944695 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -321.21045292546796 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -342.531517365775 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -420.84938370342115 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -450.04257156132417 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound -459.05344370773037 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-12-03 23:58:34,324 - stpipe.MSAFlagOpenStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:58:34,325 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-12-03 23:58:35,003 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:58:35,015 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:58:36,120 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-12-03 23:58:36,123 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.45, 'slit_y_high': 0.45}
2022-12-03 23:58:36,270 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-03 23:58:36,339 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:58:36,340 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:58:36,341 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:58:36,342 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:58:36,699 - stpipe.AssignWcsStep - INFO - Removing slit 13 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:36,714 - stpipe.AssignWcsStep - INFO - Removing slit 14 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:36,728 - stpipe.AssignWcsStep - INFO - Removing slit 15 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:36,742 - stpipe.AssignWcsStep - INFO - Removing slit 16 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:36,755 - stpipe.AssignWcsStep - INFO - Removing slit 17 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:36,768 - stpipe.AssignWcsStep - INFO - Removing slit 18 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:36,782 - stpipe.AssignWcsStep - INFO - Removing slit 19 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-03 23:58:36,782 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12]
2022-12-03 23:58:36,783 - stpipe.AssignWcsStep - INFO - Computing WCS for 12 open slitlets
2022-12-03 23:58:36,822 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-12-03 23:58:36,823 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-12-03 23:58:36,824 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-12-03 23:58:36,825 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-03 23:58:36,841 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-12-03 23:58:37,018 - stpipe.AssignWcsStep - INFO - There are 5 open slits in quadrant 1
2022-12-03 23:58:37,060 - stpipe.AssignWcsStep - INFO - There are 3 open slits in quadrant 2
2022-12-03 23:58:37,086 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 3
2022-12-03 23:58:37,118 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2022-12-03 23:58:37,119 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-03 23:58:37,275 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'fopens_metafile_msa.fits'}
2022-12-03 23:58:37,710 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-03 23:58:37,725 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:58:37,726 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
Working with slit/slice: 1 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 131 1613] [1906 1930]] Max value in slity array (ignoring NANs): 0.499879629054766 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 2 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 1330] [1824 1842]] Max value in slity array (ignoring NANs): 0.49995226747347604 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 3 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 957] [1632 1644]] Max value in slity array (ignoring NANs): 0.4997648773778204 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 4 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 906] [1320 1334]] Max value in slity array (ignoring NANs): 0.49972723641802796 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 5 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 814] [1592 1604]] Max value in slity array (ignoring NANs): 0.4997225330923289 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 6 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 50 1525] [ 680 698]] Max value in slity array (ignoring NANs): 0.49989116447537363 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 7 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 804] [240 250]] Max value in slity array (ignoring NANs): 0.49975066484744846 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 8 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 783] [164 174]] Max value in slity array (ignoring NANs): 0.49955175410051833 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 9 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 388] [1260 1270]] Max value in slity array (ignoring NANs): 0.4996146477571852 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 10 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 387] [1230 1240]] Max value in slity array (ignoring NANs): 0.4993629738181582 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 11 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 157] [1826 1834]] Max value in slity array (ignoring NANs): 0.35020493940891617 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 12 Slit min and max in y direction: -0.5 0.5 bounding box rounded to next integer: [[ 0 94] [1250 1258]] Max value in slity array (ignoring NANs): 0.4435073830894076 percentage of F/O trace that was flagged: 100.0
*** Final result for msa_flagging test will be reported as PASSED ***
('* MSA flagging validation test took ', '13.951290607452393 seconds to finish.')
Did msa_flagging validation test pass? True
Testing files for detector: nrs1
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_prism_nrs1_uncal.fits
2022-12-03 23:58:49,101 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2022-12-03 23:58:49,121 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-03 23:58:49,123 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-03 23:58:49,124 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-03 23:58:49,125 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-03 23:58:49,126 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-03 23:58:49,127 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-03 23:58:49,128 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-03 23:58:49,130 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-03 23:58:49,131 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-03 23:58:49,132 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-03 23:58:49,133 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-03 23:58:49,134 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-03 23:58:49,135 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-03 23:58:49,137 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-03 23:58:49,138 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-03 23:58:49,139 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-03 23:58:49,140 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-03 23:58:49,736 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_prism_nrs1_uncal.fits',).
2022-12-03 23:58:49,747 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-03 23:58:49,958 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-03 23:58:49,971 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits'.
2022-12-03 23:58:49,974 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-12-03 23:58:49,977 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2022-12-03 23:58:49,979 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits'.
2022-12-03 23:58:49,981 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-03 23:58:49,982 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits'.
2022-12-03 23:58:49,983 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-12-03 23:58:49,984 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-03 23:58:49,984 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-03 23:58:49,985 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2022-12-03 23:58:49,987 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits'.
2022-12-03 23:58:49,988 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-03 23:58:49,989 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-03 23:58:49,989 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-03 23:58:50,706 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:58:50,708 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:58:50,867 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-03 23:58:50,868 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-03 23:58:50,871 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-03 23:58:51,284 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:58:51,286 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:58:51,310 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits
2022-12-03 23:58:51,620 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-03 23:58:52,029 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:58:52,031 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-03 23:58:52,056 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2022-12-03 23:58:54,150 - stpipe.Detector1Pipeline.saturation - INFO - Detected 37655 saturated pixels
2022-12-03 23:58:54,192 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-03 23:58:54,206 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-03 23:58:54,491 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:58:54,493 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:58:54,493 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-03 23:58:54,496 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-03 23:58:54,836 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:58:54,837 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:58:54,865 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits
2022-12-03 23:58:55,361 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-03 23:58:55,850 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:58:55,852 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-03 23:58:56,127 - stpipe.Detector1Pipeline.refpix - INFO - NIR full frame data
2022-12-03 23:58:56,128 - stpipe.Detector1Pipeline.refpix - INFO - The following parameters are valid for this mode:
2022-12-03 23:58:56,128 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-12-03 23:58:56,129 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-12-03 23:58:56,129 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-12-03 23:58:56,130 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-12-03 23:58:56,130 - stpipe.Detector1Pipeline.refpix - INFO - The following parameter is not applicable and is ignored:
2022-12-03 23:58:56,130 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = False
2022-12-03 23:59:00,342 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-03 23:59:00,745 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:59:00,747 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:59:00,777 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2022-12-03 23:59:01,911 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-03 23:59:02,148 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:59:02,149 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-03 23:59:02,172 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits
2022-12-03 23:59:02,434 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=10, nframes=1, groupgap=0
2022-12-03 23:59:02,434 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-12-03 23:59:02,873 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-03 23:59:03,063 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:59:03,065 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-03 23:59:03,075 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-03 23:59:03,088 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-12-03 23:59:03,159 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-12-03 23:59:03,477 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-03 23:59:03,538 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-03 23:59:07,065 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 29709 pixels with at least one CR from five or more groups.
2022-12-03 23:59:11,455 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 7.977 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-03 23:59:11,567 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 8.492385
2022-12-03 23:59:11,573 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-03 23:59:11,803 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:59:11,804 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-03 23:59:11,840 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-12-03 23:59:11,841 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-12-03 23:59:11,954 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-03 23:59:11,955 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-03 23:59:56,462 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 10
2022-12-03 23:59:56,463 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-03 23:59:56,698 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-03 23:59:56,934 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:59:56,935 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:59:57,015 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:59:57,015 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:59:57,020 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:59:57,202 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:59:57,203 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-03 23:59:57,274 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-03 23:59:57,274 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-03 23:59:57,279 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-03 23:59:57,279 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-03 23:59:57,279 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-03 23:59:57,280 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-03 23:59:57,291 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-03 23:59:57,472 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-03 23:59:57,474 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-03 23:59:57,674 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2022-12-03 23:59:57,674 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2022-12-03 23:59:57,675 - stpipe.AssignWcsStep - INFO - theta_y correction: -0.005294283663966503 deg
2022-12-03 23:59:57,676 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:00:01,101 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
2022-12-04 00:00:07,750 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176998032 -45.687618307 156.178780407 -45.687618307 156.178780407 -45.686330486 156.176998032 -45.686330486
2022-12-04 00:00:07,755 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-04 00:00:07,771 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:00:07,772 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-12-04 00:00:08,758 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-12-04 00:00:09,310 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-04 00:00:09,312 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 00:00:09,510 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-12-04 00:00:09,512 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-12-04 00:00:09,688 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2022-12-04 00:00:09,689 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2022-12-04 00:00:09,690 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -0.005294283663966503 deg
2022-12-04 00:00:09,692 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:00:09,723 - stpipe.MSAFlagOpenStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-12-04 00:00:09,927 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-12-04 00:00:09,972 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-12-04 00:00:10,000 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-12-04 00:00:10,083 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-12-04 00:00:10,111 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2585.2572652943927.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2329.91715711254.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2731.341633999907.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2095.6529334650595.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2085.8983001463794.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-12-04 00:00:26,597 - stpipe.MSAFlagOpenStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:00:26,599 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-12-04 00:00:27,183 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:00:27,196 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:00:28,742 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-12-04 00:00:28,746 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.45, 'slit_y_high': 0.45}
2022-12-04 00:00:29,029 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-04 00:00:29,095 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2022-12-04 00:00:29,096 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2022-12-04 00:00:29,097 - stpipe.AssignWcsStep - INFO - theta_y correction: -0.005294283663966503 deg
2022-12-04 00:00:29,098 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:00:29,375 - stpipe.AssignWcsStep - INFO - Removing slit 1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:00:29,419 - stpipe.AssignWcsStep - INFO - Removing slit 2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:00:29,592 - stpipe.AssignWcsStep - INFO - Removing slit 6 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:00:29,634 - stpipe.AssignWcsStep - INFO - Removing slit 7 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:00:29,674 - stpipe.AssignWcsStep - INFO - Removing slit 8 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:00:30,139 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [3, 4, 5, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19]
2022-12-04 00:00:30,140 - stpipe.AssignWcsStep - INFO - Computing WCS for 14 open slitlets
2022-12-04 00:00:30,185 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2022-12-04 00:00:30,186 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2022-12-04 00:00:30,187 - stpipe.AssignWcsStep - INFO - theta_y correction: -0.005294283663966503 deg
2022-12-04 00:00:30,189 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:00:30,204 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-12-04 00:00:30,368 - stpipe.AssignWcsStep - INFO - There are 3 open slits in quadrant 1
2022-12-04 00:00:30,394 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-12-04 00:00:30,395 - stpipe.AssignWcsStep - INFO - There are 9 open slits in quadrant 3
2022-12-04 00:00:30,467 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2022-12-04 00:00:30,484 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-04 00:00:30,658 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'fopens_metafile_msa.fits'}
2022-12-04 00:00:31,164 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-04 00:00:31,180 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:00:31,181 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
Working with slit/slice: 3 bounding box rounded to next integer: [[2004 2048] [1630 1638]] Max value in slity array (ignoring NANs): 0.4996944183018942 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 4 bounding box rounded to next integer: [[2015 2048] [1320 1328]] Max value in slity array (ignoring NANs): 0.499662912467855 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 5 bounding box rounded to next integer: [[1870 2048] [1590 1600]] Max value in slity array (ignoring NANs): 0.4999703890806265 percentage of F/O trace that was flagged: 99.5
Working with slit/slice: 9 bounding box rounded to next integer: [[1508 1936] [1262 1270]] Max value in slity array (ignoring NANs): 0.4710906044496709 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 10 bounding box rounded to next integer: [[1512 1940] [1230 1240]] Max value in slity array (ignoring NANs): 0.4998853904086488 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 11 bounding box rounded to next integer: [[1157 1591] [1828 1836]] Max value in slity array (ignoring NANs): 0.49874262416463067 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 12 bounding box rounded to next integer: [[1210 1640] [1252 1260]] Max value in slity array (ignoring NANs): 0.4911423826049948 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 13 bounding box rounded to next integer: [[ 917 1353] [1692 1702]] Max value in slity array (ignoring NANs): 0.4999315450304109 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 14 bounding box rounded to next integer: [[ 816 1253] [1632 1642]] Max value in slity array (ignoring NANs): 0.4993213221807147 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 15 bounding box rounded to next integer: [[ 733 1169] [1376 1388]] Max value in slity array (ignoring NANs): 0.4995603819332174 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 16 bounding box rounded to next integer: [[ 653 1093] [1862 1874]] Max value in slity array (ignoring NANs): 0.49887079905583886 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 17 bounding box rounded to next integer: [[ 704 1141] [1518 1528]] Max value in slity array (ignoring NANs): 0.4998723633645087 percentage of F/O trace that was flagged: 99.8
Working with slit/slice: 18 bounding box rounded to next integer: [[ 856 1284] [ 206 214]] Max value in slity array (ignoring NANs): 0.4991210494201372 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 19 bounding box rounded to next integer: [[ 758 1190] [ 624 634]] Max value in slity array (ignoring NANs): 0.49985430663769975 percentage of F/O trace that was flagged: 99.8
*** Final result for msa_flagging test will be reported as PASSED ***
('* MSA flagging validation test took ', '18.98625874519348 seconds to finish.')
Did msa_flagging validation test pass? True
Testing files for detector: nrs2
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_prism_nrs2_uncal.fits
2022-12-04 00:00:46,562 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2022-12-04 00:00:46,587 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 00:00:46,589 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 00:00:46,590 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 00:00:46,591 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 00:00:46,592 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 00:00:46,593 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 00:00:46,594 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 00:00:46,595 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 00:00:46,596 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 00:00:46,598 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 00:00:46,599 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 00:00:46,600 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 00:00:46,601 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 00:00:46,602 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 00:00:46,604 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 00:00:46,605 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 00:00:46,607 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 00:00:47,152 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_prism_nrs2_uncal.fits',).
2022-12-04 00:00:47,163 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 00:00:47,364 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 00:00:47,441 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits'.
2022-12-04 00:00:47,452 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-12-04 00:00:47,458 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2022-12-04 00:00:47,463 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits'.
2022-12-04 00:00:47,507 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 00:00:47,508 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits'.
2022-12-04 00:00:47,513 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-12-04 00:00:47,514 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-04 00:00:47,514 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-04 00:00:47,514 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2022-12-04 00:00:47,529 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits'.
2022-12-04 00:00:47,532 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 00:00:47,532 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 00:00:47,533 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 00:00:48,202 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:00:48,203 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:00:48,352 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-04 00:00:48,353 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 00:00:48,355 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 00:00:48,729 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:00:48,731 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:00:48,769 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits
2022-12-04 00:00:49,060 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 00:00:49,428 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:00:49,430 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-04 00:00:49,459 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2022-12-04 00:00:51,881 - stpipe.Detector1Pipeline.saturation - INFO - Detected 21237 saturated pixels
2022-12-04 00:00:51,932 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 00:00:51,947 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 00:00:52,223 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:00:52,225 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:00:52,226 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-04 00:00:52,229 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 00:00:52,484 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:00:52,486 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:00:52,511 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits
2022-12-04 00:00:52,891 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-04 00:00:53,196 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:00:53,198 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 00:00:53,341 - stpipe.Detector1Pipeline.refpix - INFO - NIR full frame data
2022-12-04 00:00:53,343 - stpipe.Detector1Pipeline.refpix - INFO - The following parameters are valid for this mode:
2022-12-04 00:00:53,343 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-12-04 00:00:53,344 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-12-04 00:00:53,344 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-12-04 00:00:53,344 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-12-04 00:00:53,345 - stpipe.Detector1Pipeline.refpix - INFO - The following parameter is not applicable and is ignored:
2022-12-04 00:00:53,345 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = False
2022-12-04 00:00:58,364 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 00:00:58,651 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:00:58,653 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:00:58,707 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2022-12-04 00:01:00,071 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 00:01:00,359 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:01:00,361 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-04 00:01:00,395 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits
2022-12-04 00:01:00,695 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=10, nframes=1, groupgap=0
2022-12-04 00:01:00,696 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-12-04 00:01:01,242 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 00:01:01,521 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:01:01,523 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 00:01:01,534 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-04 00:01:01,556 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-12-04 00:01:01,708 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-12-04 00:01:02,072 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 00:01:02,129 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-04 00:01:05,753 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 13747 pixels with at least one CR from five or more groups.
2022-12-04 00:01:08,431 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 6.3582 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-04 00:01:08,552 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 7.017195
2022-12-04 00:01:08,557 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 00:01:08,929 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:01:08,931 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 00:01:08,984 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-12-04 00:01:08,985 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-12-04 00:01:09,120 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 00:01:09,120 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-04 00:01:53,063 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 10
2022-12-04 00:01:53,064 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-04 00:01:53,291 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 00:01:53,734 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:01:53,736 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:01:54,844 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 00:01:54,845 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 00:01:54,851 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 00:01:55,243 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:01:55,246 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:01:55,328 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 00:01:55,329 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 00:01:55,334 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 00:01:55,335 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 00:01:55,335 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:01:55,336 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 00:01:55,349 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:01:55,742 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-12-04 00:01:55,744 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 00:01:55,948 - stpipe.AssignWcsStep - CRITICAL - No IFU slices fall on detector NRS2
An error occured with AssignWcs. Likely: No open slits fall on detector nrs2 Skipping test for this file. Did msa_flagging validation test pass? skipped Testing files for detector: nrs1 Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_g395h_f290lp_nrs1_uncal.fits
2022-12-04 00:01:57,790 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2022-12-04 00:01:57,825 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 00:01:57,827 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 00:01:57,828 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 00:01:57,830 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 00:01:57,831 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 00:01:57,833 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 00:01:57,834 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 00:01:57,835 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 00:01:57,836 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 00:01:57,838 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 00:01:57,839 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 00:01:57,840 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 00:01:57,841 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 00:01:57,843 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 00:01:57,844 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 00:01:57,846 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 00:01:57,847 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 00:01:58,134 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_g395h_f290lp_nrs1_uncal.fits',).
2022-12-04 00:01:58,145 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 00:01:58,493 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_g395h_f290lp_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 00:01:58,503 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0088.fits'.
2022-12-04 00:01:58,507 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits'.
2022-12-04 00:01:58,509 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0022.fits'.
2022-12-04 00:01:58,510 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2022-12-04 00:01:58,512 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 00:01:58,512 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2022-12-04 00:01:58,514 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0019.fits'.
2022-12-04 00:01:58,516 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-04 00:01:58,516 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-04 00:01:58,517 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0031.fits'.
2022-12-04 00:01:58,518 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0117.fits'.
2022-12-04 00:01:58,520 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 00:01:58,520 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 00:01:58,521 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 00:01:59,535 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:01:59,537 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:02:00,015 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-04 00:02:00,016 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 00:02:00,019 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 00:02:00,383 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:02:00,385 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:02:00,414 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2022-12-04 00:02:01,944 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 00:02:02,336 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:02:02,337 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-04 00:02:02,363 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0031.fits
2022-12-04 00:02:08,067 - stpipe.Detector1Pipeline.saturation - INFO - Detected 176585 saturated pixels
2022-12-04 00:02:08,178 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 00:02:08,201 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 00:02:08,573 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:02:08,575 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:02:08,575 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-04 00:02:08,578 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 00:02:08,956 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:02:08,958 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:02:08,991 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0117.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-12-04 00:02:12,392 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-04 00:02:12,778 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:02:12,780 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 00:02:12,807 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0019.fits
2022-12-04 00:02:15,906 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-12-04 00:03:25,956 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 00:03:26,427 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:03:26,429 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:03:26,465 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0022.fits
2022-12-04 00:03:29,050 - stpipe.Detector1Pipeline.linearity - WARNING - Keyword BAD_LIN_CORR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 00:03:30,871 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 00:03:31,268 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:03:31,269 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-04 00:03:31,495 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0088.fits
2022-12-04 00:04:09,003 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=20, nframes=1, groupgap=0
2022-12-04 00:04:09,003 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-12-04 00:04:10,538 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 00:04:10,923 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:04:10,925 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 00:04:11,035 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-04 00:04:11,152 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits
2022-12-04 00:04:11,900 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-12-04 00:04:13,934 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 00:04:14,136 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-04 00:04:22,083 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 65989 pixels with at least one CR from five or more groups.
2022-12-04 00:04:42,258 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 28.323 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-04 00:04:42,456 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 31.421671
2022-12-04 00:04:42,462 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 00:04:42,846 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:04:42,848 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 00:04:43,165 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-12-04 00:04:43,166 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits
2022-12-04 00:04:43,261 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 00:04:43,262 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-04 00:07:24,535 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 20
2022-12-04 00:07:24,535 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-04 00:07:24,712 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 00:07:24,975 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:07:24,976 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:07:25,035 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-12-04 00:07:25,052 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 00:07:25,256 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:07:25,258 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:07:25,319 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-12-04 00:07:25,336 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 00:07:25,337 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 00:07:25,337 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:07:25,338 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 00:07:25,349 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:07:25,545 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:07:25,547 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 00:07:25,772 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:07:25,773 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:07:25,774 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:07:25,775 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:07:29,076 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0005.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
2022-12-04 00:07:38,340 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176999392 -45.687618156 156.178775679 -45.687618156 156.178775679 -45.686331563 156.176999392 -45.686331563
2022-12-04 00:07:38,343 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-04 00:07:38,357 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:07:38,357 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-12-04 00:07:38,371 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-12-04 00:07:38,779 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:07:38,780 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 00:07:38,801 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-12-04 00:07:38,802 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-12-04 00:07:39,032 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:07:39,033 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:07:39,034 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:07:39,036 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:07:39,053 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-12-04 00:07:39,215 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-12-04 00:07:39,261 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-12-04 00:07:39,289 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-12-04 00:07:39,366 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-12-04 00:07:39,393 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2525.1239286219193.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2239.8443211081017.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:83: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2382.5735098584228.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-12-04 00:07:53,455 - stpipe.MSAFlagOpenStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:07:53,456 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-12-04 00:07:54,068 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:07:54,080 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:07:54,776 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-12-04 00:07:54,778 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.45, 'slit_y_high': 0.45}
2022-12-04 00:07:54,951 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-04 00:07:55,008 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:07:55,008 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:07:55,009 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:07:55,010 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:07:55,207 - stpipe.AssignWcsStep - INFO - Removing slit 1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:07:55,226 - stpipe.AssignWcsStep - INFO - Removing slit 2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:07:55,301 - stpipe.AssignWcsStep - INFO - Removing slit 6 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-12-04 00:07:55,545 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19]
2022-12-04 00:07:55,546 - stpipe.AssignWcsStep - INFO - Computing WCS for 16 open slitlets
2022-12-04 00:07:55,582 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:07:55,583 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:07:55,584 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:07:55,585 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:07:55,601 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-12-04 00:07:55,752 - stpipe.AssignWcsStep - INFO - There are 3 open slits in quadrant 1
2022-12-04 00:07:55,775 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 2
2022-12-04 00:07:55,791 - stpipe.AssignWcsStep - INFO - There are 9 open slits in quadrant 3
2022-12-04 00:07:55,859 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2022-12-04 00:07:55,875 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-04 00:07:56,030 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0005.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'fopens_metafile_msa.fits'}
2022-12-04 00:07:56,501 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-04 00:07:56,515 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:07:56,515 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
Working with slit/slice: 3 bounding box rounded to next integer: [[1859 2048] [1638 1646]] Max value in slity array (ignoring NANs): 0.39354276760554147 percentage of F/O trace that was flagged: 99.6
Working with slit/slice: 4 bounding box rounded to next integer: [[1794 2048] [1328 1336]] Max value in slity array (ignoring NANs): 0.36978689638762896 percentage of F/O trace that was flagged: 99.6
Working with slit/slice: 5 bounding box rounded to next integer: [[1716 2048] [1598 1608]] Max value in slity array (ignoring NANs): 0.4996419343238408 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 7 bounding box rounded to next integer: [[1648 2048] [ 246 256]] Max value in slity array (ignoring NANs): 0.4998979465523029 percentage of F/O trace that was flagged: 99.7
Working with slit/slice: 8 bounding box rounded to next integer: [[1625 2048] [ 172 180]] Max value in slity array (ignoring NANs): 0.4914901689090161 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 9 bounding box rounded to next integer: [[1278 2048] [1268 1278]] Max value in slity array (ignoring NANs): 0.49972222654550663 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 10 bounding box rounded to next integer: [[1276 2048] [1238 1248]] Max value in slity array (ignoring NANs): 0.49974965593991627 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 11 bounding box rounded to next integer: [[1076 2048] [1832 1846]] Max value in slity array (ignoring NANs): 0.4995125587178428 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 12 bounding box rounded to next integer: [[ 987 2048] [1256 1270]] Max value in slity array (ignoring NANs): 0.4998321968363724 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 13 bounding box rounded to next integer: [[ 812 2048] [1696 1712]] Max value in slity array (ignoring NANs): 0.4997389937798961 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 14 bounding box rounded to next integer: [[ 702 2048] [1636 1652]] Max value in slity array (ignoring NANs): 0.49993406575349 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 15 bounding box rounded to next integer: [[ 562 2048] [1380 1398]] Max value in slity array (ignoring NANs): 0.4999204166968889 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 16 bounding box rounded to next integer: [[ 606 2048] [1864 1884]] Max value in slity array (ignoring NANs): 0.4997743958906472 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 17 bounding box rounded to next integer: [[ 568 2048] [1520 1538]] Max value in slity array (ignoring NANs): 0.4999226887144772 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 18 bounding box rounded to next integer: [[ 437 2048] [ 208 226]] Max value in slity array (ignoring NANs): 0.4999158219759617 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 19 bounding box rounded to next integer: [[ 424 2048] [ 626 646]] Max value in slity array (ignoring NANs): 0.49974363642795727 percentage of F/O trace that was flagged: 99.9
*** Final result for msa_flagging test will be reported as PASSED ***
('* MSA flagging validation test took ', '19.280149936676025 seconds to finish.')
Did msa_flagging validation test pass? True
Testing files for detector: nrs2
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_g395h_f290lp_nrs2_uncal.fits
2022-12-04 00:08:14,684 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2022-12-04 00:08:14,705 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 00:08:14,706 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 00:08:14,707 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 00:08:14,708 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 00:08:14,709 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 00:08:14,710 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 00:08:14,712 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 00:08:14,713 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 00:08:14,714 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 00:08:14,715 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 00:08:14,716 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 00:08:14,717 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 00:08:14,718 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 00:08:14,719 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 00:08:14,721 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 00:08:14,722 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 00:08:14,723 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 00:08:15,349 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y/ifu_g395h_f290lp_nrs2_uncal.fits',).
2022-12-04 00:08:15,360 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 00:08:15,737 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_g395h_f290lp_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 00:08:15,753 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0085.fits'.
2022-12-04 00:08:15,755 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits'.
2022-12-04 00:08:15,757 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0025.fits'.
2022-12-04 00:08:15,760 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2022-12-04 00:08:15,763 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 00:08:15,763 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2022-12-04 00:08:15,765 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0018.fits'.
2022-12-04 00:08:15,767 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-12-04 00:08:15,768 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-12-04 00:08:15,768 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0030.fits'.
2022-12-04 00:08:15,771 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0118.fits'.
2022-12-04 00:08:15,773 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 00:08:15,773 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 00:08:15,774 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 00:08:17,013 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:08:17,015 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:08:17,552 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-12-04 00:08:17,553 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 00:08:17,557 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 00:08:18,027 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:08:18,029 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:08:18,052 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2022-12-04 00:08:19,240 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 00:08:19,478 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:08:19,480 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'n_pix_grow_sat': 1}
2022-12-04 00:08:19,509 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0030.fits
2022-12-04 00:08:25,648 - stpipe.Detector1Pipeline.saturation - INFO - Detected 194308 saturated pixels
2022-12-04 00:08:25,802 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 00:08:25,839 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 00:08:26,332 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:08:26,335 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:08:26,336 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-12-04 00:08:26,342 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 00:08:26,863 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:08:26,865 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:08:26,909 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0118.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-12-04 00:08:31,509 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-12-04 00:08:31,756 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:08:31,757 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 00:08:31,781 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0018.fits
2022-12-04 00:08:35,048 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-12-04 00:09:46,925 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 00:09:47,508 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:09:47,510 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:09:47,541 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0025.fits
2022-12-04 00:09:49,585 - stpipe.Detector1Pipeline.linearity - WARNING - Keyword BAD_LIN_CORR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 00:09:51,669 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 00:09:51,985 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:09:51,987 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'dark_output': None}
2022-12-04 00:09:52,367 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0085.fits
2022-12-04 00:10:31,979 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=20, nframes=1, groupgap=0
2022-12-04 00:10:31,980 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-12-04 00:10:33,466 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 00:10:33,701 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:10:33,703 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 00:10:33,815 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-12-04 00:10:33,945 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits
2022-12-04 00:10:34,288 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-12-04 00:10:36,184 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 00:10:36,353 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:154: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-12-04 00:10:44,172 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 69597 pixels with at least one CR from five or more groups.
2022-12-04 00:11:10,152 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 33.9667 sec
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:302: RuntimeWarning: invalid value encountered in divide
data /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:303: RuntimeWarning: invalid value encountered in divide
err /= gain_2d
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/jump.py:304: RuntimeWarning: invalid value encountered in divide
readnoise_2d /= gain_2d
2022-12-04 00:11:10,342 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 36.526257
2022-12-04 00:11:10,348 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 00:11:10,563 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:11:10,565 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 00:11:10,943 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-12-04 00:11:10,944 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits
2022-12-04 00:11:11,037 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 00:11:11,038 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1089: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-12-04 00:13:57,882 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 20
2022-12-04 00:13:57,883 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-12-04 00:13:58,062 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 00:13:58,328 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:13:58,330 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:13:58,389 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-12-04 00:13:58,406 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 00:13:58,619 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:13:58,621 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpxni5gg5y'}
2022-12-04 00:13:58,684 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-12-04 00:13:58,702 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 00:13:58,703 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 00:13:58,703 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:13:58,704 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 00:13:58,715 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:13:58,922 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:13:58,924 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 00:13:59,137 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:13:59,138 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:13:59,140 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:13:59,141 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:14:02,564 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0005.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
2022-12-04 00:14:10,249 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176996289 -45.687617183 156.178772625 -45.687617183 156.178772625 -45.686330364 156.176996289 -45.686330364
2022-12-04 00:14:10,251 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-04 00:14:10,265 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:14:10,266 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-12-04 00:14:10,277 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-12-04 00:14:10,655 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:14:10,657 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 00:14:10,691 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-12-04 00:14:10,692 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-12-04 00:14:10,913 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:14:10,914 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:14:10,915 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:14:10,916 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:14:10,934 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-12-04 00:14:11,106 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-12-04 00:14:11,158 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-12-04 00:14:11,188 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-12-04 00:14:11,266 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-12-04 00:14:11,295 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
2022-12-04 00:14:27,165 - stpipe.MSAFlagOpenStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:14:27,166 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-12-04 00:14:27,856 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:14:27,869 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-12-04 00:14:28,581 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-12-04 00:14:28,583 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.45, 'slit_y_high': 0.45}
2022-12-04 00:14:28,767 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-12-04 00:14:28,829 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:14:28,831 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:14:28,831 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:14:28,833 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:14:29,407 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19]
2022-12-04 00:14:29,408 - stpipe.AssignWcsStep - INFO - Computing WCS for 19 open slitlets
2022-12-04 00:14:29,446 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-12-04 00:14:29,447 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-12-04 00:14:29,448 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-12-04 00:14:29,449 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-12-04 00:14:29,465 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-12-04 00:14:29,620 - stpipe.AssignWcsStep - INFO - There are 5 open slits in quadrant 1
2022-12-04 00:14:29,660 - stpipe.AssignWcsStep - INFO - There are 3 open slits in quadrant 2
2022-12-04 00:14:29,684 - stpipe.AssignWcsStep - INFO - There are 9 open slits in quadrant 3
2022-12-04 00:14:29,754 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2022-12-04 00:14:29,771 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-12-04 00:14:29,937 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0005.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'fopens_metafile_msa.fits'}
2022-12-04 00:14:30,511 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-12-04 00:14:30,526 - stpipe.AssignWcsStep - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 00:14:30,527 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
Working with slit/slice: 1 bounding box rounded to next integer: [[ 331 2048] [1914 1946]] Max value in slity array (ignoring NANs): 0.4998831147473369 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 2 bounding box rounded to next integer: [[ 46 2048] [1832 1862]] Max value in slity array (ignoring NANs): 0.49994239693485726 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 3 bounding box rounded to next integer: [[ 0 2048] [1638 1668]] Max value in slity array (ignoring NANs): 0.49992568371104673 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 4 bounding box rounded to next integer: [[ 0 2048] [1328 1356]] Max value in slity array (ignoring NANs): 0.49997225701044107 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 5 bounding box rounded to next integer: [[ 0 2048] [1598 1628]] Max value in slity array (ignoring NANs): 0.49996521163224844 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 6 bounding box rounded to next integer: [[ 188 2048] [ 688 712]] Max value in slity array (ignoring NANs): 0.49982756864902916 percentage of F/O trace that was flagged: 99.9
Working with slit/slice: 7 bounding box rounded to next integer: [[ 0 2048] [ 248 270]] Max value in slity array (ignoring NANs): 0.49952809423454014 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 8 bounding box rounded to next integer: [[ 0 2048] [ 172 194]] Max value in slity array (ignoring NANs): 0.4999761295693984 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 9 bounding box rounded to next integer: [[ 0 2048] [1268 1296]] Max value in slity array (ignoring NANs): 0.49986787703942764 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 10 bounding box rounded to next integer: [[ 0 2048] [1238 1266]] Max value in slity array (ignoring NANs): 0.4999627619280446 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 11 bounding box rounded to next integer: [[ 0 2048] [1832 1864]] Max value in slity array (ignoring NANs): 0.49986310206990686 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 12 bounding box rounded to next integer: [[ 0 2048] [1256 1284]] Max value in slity array (ignoring NANs): 0.49992178396516856 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 13 bounding box rounded to next integer: [[ 0 2048] [1696 1726]] Max value in slity array (ignoring NANs): 0.49977105805900096 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 14 bounding box rounded to next integer: [[ 0 2048] [1636 1666]] Max value in slity array (ignoring NANs): 0.4999166217521449 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 15 bounding box rounded to next integer: [[ 0 1980] [1380 1406]] Max value in slity array (ignoring NANs): 0.4999679347315006 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 16 bounding box rounded to next integer: [[ 0 2033] [1864 1894]] Max value in slity array (ignoring NANs): 0.49992408655614395 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 17 bounding box rounded to next integer: [[ 0 1989] [1520 1548]] Max value in slity array (ignoring NANs): 0.4998243708705976 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 18 bounding box rounded to next integer: [[ 0 1838] [ 208 228]] Max value in slity array (ignoring NANs): 0.4999277036218135 percentage of F/O trace that was flagged: 100.0
Working with slit/slice: 19 bounding box rounded to next integer: [[ 0 1828] [ 626 648]] Max value in slity array (ignoring NANs): 0.4999228119213873 percentage of F/O trace that was flagged: 100.0
*** Final result for msa_flagging test will be reported as PASSED ***
('* MSA flagging validation test took ', '23.423705577850342 seconds to finish.')
Did msa_flagging validation test pass? True
# Quickly see if the test passed: Do the NIRSpec implementation and the pipeline's agree within <= 99.5%?
print('These are the final results of the tests: ')
for key, val in results_dict.items():
if not isinstance(val, str):
if val:
val = 'PASSED'
else:
val = 'FAILED'
print('{:<40} {:<8}'.format(key, val))
These are the final results of the tests: mos_prism_nrs1_uncal.fits FAILED mos_prism_nrs2_uncal.fits skipped mos_g140m_line1_NRS1_uncal.fits PASSED mos_g140m_line1_NRS2_uncal.fits PASSED ifu_prism_nrs1_uncal.fits PASSED ifu_prism_nrs2_uncal.fits skipped ifu_g395h_f290lp_nrs1_uncal.fits PASSED ifu_g395h_f290lp_nrs2_uncal.fits PASSED